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ABSTRACT. Novel coronavirus (nCoV) belongs to the Coronaviridae 
family, which includes the virus that causes SARS, or severe acute 
respiratory syndrome. However, infection source, transmission route, 
and host of nCoV have not yet been thoroughly characterized. In 
some cases, nCoV presented a limited person-to-person transmission. 
Therefore, early diagnosis of nCoV may be of importance for reducing 
the spread of disease in public. Methods for nCoV diagnosis involve 
smear dyeing inspection, culture identification, and real-time PCR 
detection, all of which are proved highly effective. Here, we performed 
a meta-analysis to evaluate the effectiveness of real-time PCR for 
diagnosing nCoV infection. Fifteen articles conformed to the inclusion 
and exclusion criteria for further meta-analysis on the basis of a wide 
range of publications searched from databases involving PubMed, 
EMBASE, Web of Science, Medline, ISI. We analyzed the stability 
and publication bias as well as examined the heterogeneity inspection 
of real-time PCR detection in contrast to smear staining and culture 
identification. The fixed-effect model was adopted in our meta-analysis. 
Our result demonstrated that the combination of real-time PCR and 
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smear diagnostics yielded an odds ratio (OR) = 1.91, 95% confidence 
interval (CI) = 1.51-2.41, Z = 5.43, P< 0.05, while the combination of 
real-time PCR and culture identification yielded OR = 2.44, 95%CI = 
1.77-3.37, Z = 5.41, P < 0.05. Therefore, we propose real-time PCR 
as an efficient method that offers an auxiliary support for future nCoV 
diagnosis. 
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INTRODUCTION 


Coronavirus belongs to the Coronavirus genus of the family Coronaviridae; one 
of its variants, named SARS virus, can cause severe acute respiratory syndrome (SARS) 
(Bermingham et al., 2012). Between June 2012 and September 2012, acute lower respira- 
tory infection cases were reported in the Middle East, with pathology similar to that of 
SARS. Of these, one patient was hospitalized in an intensive care unit and another patient 
died; they both appeared to have severe acute respiratory infection combined with renal 
failure (Assiri et al., 2013; Scobey et al., 2013; Martinez et al., 2014). World health orga- 
nization (WHO) determined that the pathogen is a novel coronavirus with many similari- 
ties to SARS virus (Ge et al., 2013). A British scientist released its complete sequence 
recently (Corman et al., 2012). Three days later, European Union scientists devised the 
real-time PCR method to detect this novel coronavirus; this test makes rapid diagnosis 
possible (WHO, 2012). Coronavirus widely exists among humans and animals such as 
bats, mice, cats, dogs, pigs, and cattle, and these animals are closely related to human 
beings. The virus can be transmitted between humans and animals (Jadad et al., 1996). 
Timely and accurate diagnosis is necessary for effective treatment of novel coronavi- 
rus (nCoV) infection. Smear dyeing inspection, culture identification, and real-time PCR 
were reported being used for coronavirus detection, among which, real-time PCR is high- 
ly effective (Poon et al., 2003, 2005), but smear dyeing inspection has lower sensitivity 
and specificity (Pebody et al., 2012), while culture identification is relatively simple and 
has high specificity but is time consuming (Khuri-Bulos et al., 2014). Methods for early 
detection and diagnosis of Middle East respiratory syndrome coronavirus, to the same 
extent, are required, especially in the treatment of early-infected patients (Al-Abdallat et 
al., 2014). Real-time PCR is rapid with high sensitivity and specificity, so that is prefer- 
able for the clinical diagnosis of nCoV infection (Hadjinicolaou et al., 2011). In this study, 
we validate the effectiveness of real-time PCR for nCoV diagnosis through a systematical 
meta-analysis on the qualified literature. 


MATERIAL AND METHODS 
Sources of data 


Foreign databases including PubMed, EMBASE, Web of Science, Medline, and ISI 
were searched, and articles published after August 2003 were collected. The enrolled data did 
not include unpublished literature and conference papers. The key words were “real-time PCR” 
and “novel coronavirus”. Manual searching and literature retrospection were also performed. 
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Inclusion criteria 


We included clinical case-control studies or experimental case-control studies, with 
available line x row information on nCoV as a research object; international (English lan- 
guage) articles published with open access after October 2003; studies with real-time PCR 
detection as the research subject; and studies using smear dyeing inspection or culture identi- 
fication for nCoV as a control group. 


Exclusion criteria 


We excluded duplicated data, with too little information, no control group, without or 
with wrong data analysis methods, inconsistent data, reviews, and conference papers. 


Literature screening and quality evaluation 


Two researchers independently screened the articles in accordance with the 
abovementioned criteria. QUADAS (Whiting et al., 2003) list was used for the literature 
evaluation. QUADAS entries include 1) whether the spectrum of cases includes all kinds 
of cases; 2) whether the selection criteria of the research object are clear; 3) whether the 
two test methods for evaluation are valid for nCoV infection; 4) whether the test method’s 
time interval is short enough to not be affected by a patient’s status change; 5) whether 
the patients were tested with both of the two methods; 6) whether the same group in each 
study received the same test method; 7) whether the two test methods are independent 
(lacking any relationship with each other); 8) whether the test method is clearly described 
and can be repeated; 9) whether each test was blinded in terms of the results of the other 
simultaneous tests. 


Data analysis 


The collected data were checked to establish a database. Review Manager 5.3 was 
used for statistical analysis. A heterogeneity test of the literature was performed before 
the meta-analysis to determine the suitable statistic consolidation method. We tested for 
heterogeneity using the Cochran Q test, which follows a chi-square distribution, with q 
= 0.10. The 7 value was used to demonstrate the percentage of interstudy variation in the 
total variation (including interstudy variation and systematic error). 2’ < 25% meant low 
heterogeneity; / between 25 and 50% represented moderate heterogeneity; and ’ > 50% in- 
dicated high heterogeneity. The random-effect model (the Dersimonian-Laird method) was 
chosen if heterogeneity was present; the fixed-effect model (the Mantel-Haenszel method) 
was selected when there was no heterogeneity. An odds ratio (OR) between the observation 
group and control group was selected as the effect index, and the OR for the combination 
of methods with its 95% confidence interval (CI) were calculated. The sensitivity of the 
methods from the literature was analyzed by comparing the combined-effect differences 
and the conclusion difference after removal of articles with fewer samples when choosing a 
different statistical model. Funnel diagram analysis and Egger tests were used for detection 
of a possible publication bias. 
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RESULTS 
General characteristics 


In total, 132 articles were found. Thirty-one articles remained after excluding reviews, 
duplicated publications, and unrelated articles. Of these, 16 articles were eliminated after qual- 
ity evaluation according to the inclusion and exclusion criteria. Finally, 15 clinical case-con- 
trol studies on the real-time PCR method for nCoV infection detection were enrolled (Table 1). 


Table 1. General information regarding the 15 articles on real-time PCR detection of novel coronavirus 
infection. 


Author Testing program — Control method Real-time PCR group Control group 
Positive N Total N Positive N Total N 

Poon et al., 2003 RCT Smear dyeing 22 50 11 50 
van Elden et al., 2004 RCT Smear dyeing 28 261 20 243 
Gaunt et al., 2010 RCT Smear dyeing 14 31 1 10 
Hemida et al., 2014 RCT Smear dyeing 37 98 44 170 
Poon et al., 2005 RCT Smear dyeing 14 15 9 15 
Shirato et al., 2014 RCT Smear dyeing 80 105 52 105 
Neske et al., 2007 RCT Smear dyeing 21 49 13 49 
Parida et al., 2005 RCT Smear dyeing 87 100 81 100 
Luetal., 2012 RCT Smear dyeing 41 239 6 239 
Bolotin et al., 2009 RCT Smear dyeing 40 40 60 61 
Guo et al., 2009 RCT Cultivation 22 49 12 49 
van Elden et al., 2004 RCT Cultivation 20 43 12 49 
Templeton et al., 2005 RCT Cultivation 15 31 1 9 
Scheltinga et al., 2005 RCT Cultivation 38 99 43 170 


Bolotin et al., 2009 RCT Cultivation 78 107 51 105 


RCT = Regents competency test. N = number. 
Study results 


We analyzed the results of real-time PCR detection, smear dyeing inspection, and cul- 
ture identification. As shown in Figure 1, heterogeneity analysis of the enrolled articles was per- 
formed. The heterogeneity between real-time PCR and smear dyeing inspection was y’ = 10.89, 
P > 0.05, ? = 0.17%; heterogeneity did not exist between the studies. The fixed-effect model 
was selected for our meta-analysis, Z = 5.43, P < 0.05. Combination OR was 1.91 (95%CI = 
1.51-2.41). It showed that the real-time PCR method is superior to smear dyeing inspection. 
As shown in Figure 2, heterogeneity analysis of the enrolled articles was performed. The het- 
erogeneity between real-time PCR and smear dyeing inspection was 7 = 2.41, P > 0.05, ? = 
0%; heterogeneity did not exist among the studies. The fixed-effect model was selected for our 
meta-analysis, Z = 5.41, P < 0.05. The combination OR was 2.44 (95%CI = 1.77-3.37). This 
result showed that real-time PCR method was superior to culture identification. 


Identification of publication bias 


Because meta-analysis is a type of observational study, errors can occur in the process 
of study inclusion and analysis, resulting in incorrect results. The funnel plot can be used to 
evaluate the bias of the literature. As shown in Figures 3 and 4, the graphs between real-time 
PCR and smear dyeing inspection, as well as those between real-time PCR and culture iden- 
tification, were almost symmetrical. Most studies were located at the top of the funnel figure, 
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which means that the research publication bias was small. The Egger test showed that the 
publication bias between real-time PCR and smear dyeing inspection, as well as that between 
real-time PCR and culture identification was P = 0.103 and P = 0.043, respectively. This find- 
ing suggested that the publication bias existed between real-time PCR and cultivation identi- 
fication but not between real-time PCR and smear dyeing inspection. 


Experimental Control Odds Ratio Odds Ratio 
Study or Subgrow Total Events Total Weight M-H, Fixed, 95%CI M-H, Fixed, 95%C' 


Bolotin S 2009 78 107 51 105 29.8% 2.85 (1.61, 5.05] 
Guo L 2009 22 49 12. 49 14.1% — 2.51 [1.06, 5.94] 
Neske F 200? 20 43 12. 49 12.8% 2.68 (1.11, 6.50) 
Parida M 2005 15 31 1 9 1.7% 7.50 (0.84, 67.35] 
Scheltinga SA 2005 38 99 43 170 41.6% 1.84 (1.08, 3.13] 
Total (95% Cl) 329 382 100.0%  2.44[1.77, 3.37] 
Total events 173 119 


Heterogeneity: Chi? = 2.41, df= 4 (P = 0.66); F=0% 
Test for overall effect Z= 5.41 (P < 0.00001) 


0.01 0.1 1 10 100 
Favors [experimental] Favors [control] 


Figure 1. Forest map between real-time PCR and culture identification. 


Experimental Control Odds Ratio Odds Ratio 
Weight_M-H, Fixed, 95%CI M.-H, Fixed, 95%CI 
Bolotin S 2009 41 239 32 239 «25.6% 1.34 (0.81, 2.21] 
Gaunt ER 2010 14 31 1 10 408% 7.41 (0.83, 65.81] 
Neske F 2007 28 261 20 243 17.9% 1.34 (0.73, 2.45] 
Parida M 2005 87 100 81 100 10.2% 1.57 (0.73, 3.38) 
Poon LL 2003 22 50 11 $0 59% 2.79[1.17, 6.66) 
Poon LL 2005 14 15 9 16 0.6% 9.33 (0.96, 90.94) 
Hemida MG 2014 80 105 62 105 12.0% 3.26 [1.81, 5.88) 
Scheltinga SA 2005 40 40 60 61 06% 2.01 (0.08, 50.53) 
Templeton KE 2005 37 98 44 170 19.3% 1.74 (1.02, 2.96) 


Van Elden LJ 2004 21 49 13 49° 7.2% =: 2.08 [0.89, 4.86] 


Total (95% Cl) 988 1042 100.0%  1.91[1.51, 2.41] 
Total events 384 323 

Heterogeneity: Chit = 10.89, df= 9 (P= 0.28); F=17% 

Test for overall effect: Z= 5.43 (P < 0.00001) 


0.01 0.1 1 10 100 
Favors [experimental] Favors [control] 


Figure 2. Forest map between real-time PCR and smear dyeing inspection. 
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Figure 3. Funnel diagram between real-time PCR and smear dyeing inspection on novel coronavirus infection. 
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Figure 4. Funnel diagram between real-time PCR and culture identification on novel coronavirus infection. 


DISCUSSION 


We analyzed the effectiveness of real-time PCR at diagnosing nCoV infection by 
means of evidence-based medicine. Fifteen articles on real-time PCR method for nCoV infec- 
tion detection were identified as candidates among 132 studies, according to the inclusion and 
exclusion criteria of quality evaluation. 

Meta-analysis was conducted to evaluate the usefulness of real-time PCR for diag- 
nosing nCoV infection. The results suggest that the real-time PCR method is superior to both 
smear dyeing inspection and culture identification. The funnel diagram is generally considered 
a reference index for bias in meta-analysis. Our research showed that the two funnel diagrams 
are symmetrical. The Egger test showed that a publication bias existed between real-time PCR 
and culture identification, which might be caused by the information bias. 

Our meta-analysis results indicate that the real-time PCR method is effective at detec- 
tion of nCoV infection. The combination OR value revealed that the real-time PCR method is 
2.44-fold more sensitive than culture identification, and 1.91-fold more sensitive than smear 
dyeing inspection.The real-time PCR therefore shows favorable profile of nCoV infection detec- 
tion compared to smear dyeing inspection and culture identification and has been widely used. 

Despite effective for diagnosing nCoV, real-time PCR has not yet been satisfactory 
with some limitations of false-positive and false-negative results. A false-positive result is 
mainly due to contamination that occurs at some point in the entire operating procedure. Thus, 
each step must strictly abide by the relevant operation specifications in the process of PCR 
detection. A false-negative result is mainly caused by irregularities in the procedure that can 
result in DNA damage. The DNA extraction procedure will affect genomic DNA amount, 
quality, and integrity and thus will affect the process of DNA amplification. A high concentra- 
tion of genomic DNA can lead to a considerable amount of nonspecific products, whereas too 
little genomic DNA might result in failure to detect some sequences (ECDC, 2012). 

In the present study, we formulated a comprehensive search strategy according to 
the requirements of systematic evaluation, and two researchers participated in the searching 
and extraction process at the same time. Nevertheless, there are still some limitations to this 
study: 1) The number of the enrolled articles is relatively small; this situation may cause a 
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bias. 2) There are no limitations on age, race, or present illness information, and a stratified 
meta-analysis was not performed. 3) The retrieval language was limited to English; therefore, 
a language bias cannot be ruled out. In conclusion, real-time PCR is an efficient method for 
detecting nCoV infection and can be disseminated as an auxiliary assay for detecting nCoV 
infection. 
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